No,:10014330-1 




LAYOUT DESIGN APPARATUS AND METHOD FOR THREE- 
DIMENSIONAL GRAPHICAL ENVIRONMENTS 

FIELD OF THE INVENTION 
[0001] The present invention relates to a technique for designing the layout of a three- 
dimensional graphical environment and in particular, this disclosure provides an 
apparatus and method for partitioning a three-dimensional graphical environment 
dependent on a data object database and the data objects' associated metadata. 

BACKGROUND OF THE INVENTION 

[0002] Databases are often used to store information relating to large numbers of 
objects such as products, works of art, museum pieces, or books. Due to their size, it 
can be difficult to search or browse through the information stored in these databases. 
In many applications, it is particularly desirable to make browsing through these 
databases an intuitive or simple process, particularly for unsophisticated computer 
users or browsers. For instance, online shopping has gained popularity mainly due to 
its convenience. In particular, shopping can be quickly accomplished in the comfort 
of one's own home or office at any time, day or night. As a result, many retail stores 
have websites on the Internet that allow a user to select a product and purchase it 
online. However, if it is difficult for a typical consumer having liinited computer 
savvy to find products on the website, the convenience of on-line shopping becomes 
severely diminished. 

[0003] Three-dimensional graphical environments have been used to allow viewing of 
and navigation through information and databases (such as on a retail website) in an 
intuitive manner. Specifically, a three-dimensional graphical environment allows a 
user to intuitively navigate within a virtual space and hence easily locate and view 
items within the space. In order to create a three-dimensional graphical environment, 
it is typical to divide or partition the environment into a plurality of three-dimensional 
areas (e.g. rooms) that has the effect of logically dividing and displaying the objects 
within the environment. Essentially, partitioning the environment and distributing 
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objects within the partitioned environment facilitates navigation through the 
environment. 

[0004] Currently, algorithms for partitioning a three-dimensional graphical 
environment are designed to accommodate a statically partitioned environment in 
which the number of items that are placed within each partitioned area does not 
change. As a result, the partitions need only be determined once and consequently the 
complexity of the algorithm is of little or no concern. However, in the case of a 
dynamically partitioned environment, in which the environment may be continually 
repartitioned and objects may be changed in numbers and/or regrouped and 
repositioned, the partition algorithm needs to have a minimal impact on the total 
process of rendering the three-dimensional graphical environment. 

[0005] The present invention is an apparatus and method of generating a three- 
dimensional graphical environment for viewing a plurality of objects in a database and 
more particularly, is an apparatus and method of partitioning the three-dimensional 
graphical environment in an aesthetically pleasing, logical, and simplified manner to 
further enhance browsability and navigation of the environment. 

SUMMARY OF THE INVENTION 

[0006] An apparatus and method for partitioning a three-dimensional graphical 
environment for displaying images representing a database of objects is described. 

[0007] According to one embodiment of the method, a database of objects is 
represented by a hierarchical tree derived from the data object metadata. A 
predetermined parent node is pre-assigned an area corresponding to an undivided 
three-dimensional graphical environment. Then, starting with the predetermined 
node, for each parent node having at least two associated child nodes in the tree, the 
area is recursively partitioned into a plurality of areas corresponding to each of the 
associated child nodes such that the areas are proportional to the child node weights. 



Docket No.:10014330-1 




[0008] The apparatus according to one embodiment of the present invention includes a 
tree deriver, a weight determiner, and an area partitioner. The tree deriver derives a 
hierarchical tree representative of a database of objects from the object metadata. The 
weight determiner determines an associated weight for each node of the tree and 
provides it to the area partitioner such that the area associated with the graphical 
environment is partitioned into a plurality of areas proportional to the node weights of 
the hierarchical tree. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 illustrates a prior art system for rendering and displaying a three- 
£5 dimensional graphical environment; 

ci 

[0010] Fig. 2A illustrates a first embodiment of a method for partitioning a three- 
pj dimensional graphical environment according to the present invention; 

"^"^ [0011] Fig. 2B illustrates an example of a hierarchical tree representing a database of 
data objects dependent on associated metadata; 

C3 

h 5 

ti [0012] Fig. 2C illustrates an example of a three-dimensional graphical environment 

C3 partitioned according to the method of present invention shown in Fig. 2A; 

•J . 

[0013] Fig. 3 illustrates a second embodiment of a method for partitioning a three- 
dimensional graphical environment according to the present invention; 

[0014] Fig. 4 illustrates a first embodiment of an apparatus for partitioning a three- 
dimensional graphical environment; and 

[0015] Fig. 5 illustrates a second embodiment of an apparatus for partitioning a three- 
dimensional graphical environment. 
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DETAILED DESCRIPTION 

[0016] An apparatus and method for partitioning a three-dimensional graphical 
environment for displaying representative images of data objects is described in which 
the environment is partitioned according to the data objects and their corresponding 
metadata. In general, the present invention is directed towards an apparatus and 
method in which partitioning is performed dependent on a hierarchical tree derived 
from metadata associated with the data objects. The tree is used to define a grouping 
of the data objects in the database according to at least one selected metadata type. 
The tree includes a plurality of nodes that are weighted dependent, at least in part, on 
data object node weight. The node weighting is then used to divide the environment 
into areas, each area proportional to a corresponding node weighting. 

[0017] It should be noted that according to this description, a data object is broadly 
defined as data stored within a database that corresponds to a tangible or intangible 
object or element. Examples of types of data objects can include but are not limited 
by image data, audio data, word processing data, video data, and three-dimensional 
data. Examples of types of objects or elements can include but are not limited to 
movie videos, CDs, works of art, electronic word processing documents, electronic 
personnel records and conmiercial inventory. If, for instance, the object type is movie 
videos, a specific object of that type would be a particular movie. 

[0018] Each data object has associated data referred to as metadata which corresponds 
to any data other than the data object itself that describes or relates to the data object, 
and each data object may have different types of metadata. For instance, in the case in 
which the object type is movie videos, types of metadata may include data 
corresponding to the title, director, release date, actors, and genre (e.g., comedy, 
drama) etc. In contrast, in the case in which the object type is artwork, types of 
metadata may include title of the work and school of art (e.g., modem, 
impressionistic). Metadata can be stored with the data object or may be stored 
separately such that a link exists between the data object and its associated metadata. 
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[0019] In general, a plurality of data objects stored within a database are related such 
that they can be logically viewed, categorized, grouped, ordered and/or arranged in 
some way with respect to their associated data object metadata. For instance, movies 
stored within a database can be grouped according to director so as to allow a viewer 
to review the data by a particular director. 

[0020] According to the present invention, representative images of data objects 
stored within a database are displayed within a three-dimensional graphical 
environment to provide a user who wants to browse the database the ability to 
intuitively view the data objects. In accordance with the present invention, 
representative images can be embodied as text labels, natural images, graphical 
images, document and file folder images, video images, three-dimensional models, or 
any type of visual data related to or representative of the object. Moreover, 
representative images can be interactive when directly or indirectly selected by the 
user. For instance, a representative image embodied as a three-dimensional model 
may be rotated by a user to provide the user with additional views of the model. 
Alternatively, a representative image embodied as a video image may begin to play 
when a user approaches it within the three dimensional environment. In addition, 
representative images may be directly or indirectly selected to access additional 
related multi-media data. For instance, a two-dimensional representative image may 
be selected so as to access an audio clip associated with the data object, access a three- 
dimensional model of the corresponding two-dimensional image, access a video 
sequence, etc. 

[0021] An example of a system for rendering and displaying a three-dimensional 
image is shown in Fig. 1 that includes a graphics processing unit 10, a rendering 
engine 11, a user output 12, a user input 13, and memory 14. The graphics processing 
unit 10 functions to receive data object data lOA and generate three-dimensional 
imaging data lOB corresponding to a three-dimensional environment including 
representative images of the data objects within the three-dimensional environment as 
is well known in the field of graphics imaging. Rendering Engine 1 1 receives imaging 
data lOB and generates rendering data llA for driving user output 12. For instance, 
rendering data llA drives a monitor (not shown) to display the three-dimensional 
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environment including the representative images. User input 13 provides an interface 
between a user and the three-dimensional environment so as to allow the user to 
interact with the three-dimensional environment. For instance, the user input 13 
allows a user to change a point of view within the three-dimensional environment by 
moving a displayed cursor using a keyboard or mouse. Other types of user input 13 
include but are not limited to a joystick and a pressure sensitive screen. Graphics 
processing unit 10 may function to generate the representative images of the data 
objects or the representative image data may be stored within the memory 14 and 
linked to the data object database. 

[0022] According to a first embodiment of the method of the present invention as 
shown in Fig. 2A, a database of objects is presented by a hierarchical tree derived 
from object metadata (block 20), a predetermined node is pre-assigned an area 
corresponding to an undivided three-dimensional graphical environment (block 21). 
Then, starting at the predetermined node, for each area corresponding to each parent 
node having at least two associated child nodes in the tree, the area is recursively 
partitioned into a plurality of areas corresponding to each of the associated child nodes 
such that the areas are proportional to the child nodes' weights (block 22). 

[0023] Fig. 2B shows an example of a database represented by a hierarchical tree. 
The tree includes a plurality of nodes 23, 24A, 24B, 25A-25C, 25D-25F, and 26. The 
tree nodes can be classified as a parent node or child node dependent on their 
relationship to other nodes in the tree. For instance, node 23 is the parent node to 
child nodes 24 A and 24B, node 24A is the parent node to child nodes 25A-25C, node 
24B is the parent node to child nodes 25D-25F. Nodes 26 are data object nodes each 
corresponding to one of the data objects within the database. Hence, each of the 
nodes 25A-25F is the parent node of a corresponding group of data object child nodes. 

[0024] In addition, each of the nodes 23-25 corresponds to different metadata types 
used for classifying the data object nodes 26. For instance, nodes 24 correspond to 
product function type that includes computing type products and imaging type 
products. Under the computing type product node are a first set of device type nodes 
including notebooks, handhelds, and desktops. Under the imaging type product node 
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are a second set of device type nodes including scanners, printers, and cameras. 
Under each of the device type nodes are the actual products each corresponding to a 
data object within the database. 

[0025] Each node in the tree has a weight determined by the weighting of data objects 
associated with it. The weight of a given node is determined by traversing downward 
along all continuous paths within the tree to the data object nodes to determine the 
combined weighting of the data objects associated with the given node along the 
continuous path. For instance, in this example, assuming each data object node has a 
weighting of one, node 25 A has a weight W=4, node 25B has a weight W=2, node 
25C has a weight W=3, node 25D has a weight W=4, node 25E has a weight W=2, 
node 25F has a weight W=5. Hence, by traversing from each of nodes 24A and 24B 
to data object nodes 26 along all continuous paths within the tree, node 24A has a 
€3 weight W=9 and node 24B has a weight W=ll. It should be noted that according to 

■•i 'J 

Li, the apparatus and method of the present invention, nodes can be weighted in a variety 
^ of manners according to the users preference, system default settings, or other node 
|iJ weighting methodologies. For instance, the object nodes may have a weight greater 

than one or some non-object nodes (e.g., 23-25) may have an additional associated 
£J weighting factor that is not dependent on the weight of the data objects associated 
Q with them. As a result, node weight determination may be dependent on the manner 

in which the nodes of the tree are initially weighted in addition to the data object 

weight associated with it. In other cases, the weight of the nodes may be indirectly 

related to the data object weight associated with it. 

[0026] Fig. 2C shows an example of a two-dimensional area corresponding to the 
layout of a three-dimensional graphical environment partitioned according the method 
of the present invention using the hierarchical tree shown in Fig. 2B. In this example, 
the database of objects is represented by a hierarchical tree derived from object 
metadata by grouping objects according to three metadata types: electronic products, 
their function, and device type. Next, the topmost node of the tree, node 23, is pre- 
assigned to an undivided three-dimensional graphical environment. In this example, 
the three-dimensional environment corresponds to the two-dimensional area 27 
bounded by vertices AUD (Fig. 2C). Node 23 is a parent node having at least two 
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child nodes including nodes 24A and 24B. Each of child nodes 24A and 24B have a 
weight of W=9 and W=l 1, respectively. Then, starting with node 23, area 27 is 
divided by partition 27A to form two areas each proportional to the weights of nodes 
24 A and 24B: one corresponding to computing products and the other corresponding 
to imaging products. More particularly, the area corresponding to computing products 
is 9/20 of the total area 27 and the area corresponding to imaging products is 1 1/20 of 
the total area 27. Similarly, the computing products area (Fig. 2C) associated with the 
next parent node in the tree, node 24A, is proportionally divided by partitions 28A and 
28B dependent on the weights of nodes 25A-25C and the imaging products area (Fig. 
2C) associated with the last parent node, 24B, is proportionally divided by partitions 
29A and 29B dependent on the weights of nodes 25D-25F. 

[0027] Fig. 3 shows a second embodiment of the method of partitioning a three- 
dimensional graphical environment. First, the database of objects is represented by a 
hierarchical tree derived from object metadata (block 30) and a predetermined node is 
pre-assigned an area corresponding to an undivided three-dimensional graphical 
environment (block 31). Next, starting with the predetermined node, the child nodes 
of each parent node including at least two nodes each are divided into N groups of one 
or more nodes each (block 32). For instance, in the case in which N=2 and referring 
to the example shown in Fig. 2B, the child nodes 25A-25C of parent node 24 A are 
divided into two groups. The nodes are divided such that the combined normalized 
weight, Wn, of each group approaches a ratio of R=I/N (block 32), or in this case R = 
0.5. Moreover, the normalized weights of nodes 25 A, 25B, 25C are Wn=4/9, Wn=2/9 
and Wn=3/9 respectively. The following are three possible groupings of these three 
nodes into two groups of nodes and the combined normalized weight (WEIGHT 1 and 
WEIGHT2) of each of the two groups (GROUPl and GROUP2) for each grouping: 



GROUPING* 


GROUPl 


GROUP 2 


WEIGHT 1 


WEIGHT 2 


1 


25A and 25B 


25C 


6/9 


3/9 


2 


25A 


25B AND 25C 


4/9 


5/9 


3 


25A AND 25C 


25B 


7/9 


2/9 



Table 1 
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Table 1 shows GROUPING#2 having GROUP 1 and GROUP2 each having combined 
normalized weights that approach the ratio of 0.5 where GROUP 1 includes node 25 A 
and GROUP2 includes nodes 25B and 25C. It should be noted that not all possible 
groupings need to be evaluated as shown in Table 1. This is especially true for trees 
having a large number of nodes. For instance, in one embodiment only groupings that 
keep the same left-to-right ordering as shown in the tree are considered. Referring to 
the above example, only GROUPING*! and GROUPBMG#2 would be considered as 
possible groupings because GROUPING#3 does not preserve the left-to-right 



[0028] Next, the area corresponding to the parent node associated with the groups of 
child nodes is partitioned dependent on each group's ratio (block 33). In this case, the 
area associated with the parent node is the computing products area which is then 
proportionally divided by partition 28A into two areas dependent on each of their 
combined ratios (i.e., 4/9 and 5/9), the smaller area corresponding to node 25 A (i.e., 
GROUPl) and the larger area corresponding to nodes 25B and 25C (i.e., GROUP2). 
As shown in Fig. 2C, partition 28A divides the area corresponding to the computing 
product bounded by comers A,B,C,D into two areas A,B,F,E and E,F,C,D. Area 
A,B,F,E is assigned to the notebook products group (node 25 A, GROUPl) and area 
E,F,C,D is assigned to the handheld and desktop products (nodes 25B and 25C, 
GROUP2). 

[0029] According to the method shown in Fig. 3, blocks 32-33 are repeated for all 
groups associated with the parent node until each group includes a single node. 
Following the example, GROUP2 includes two nodes, 25B and 25C, so according to 
block 34, blocks 32-33 are repeated on this group such that GROUP2 is divided into 
two groups (block 32). Since there are only two nodes in the group and there is only 
one way to divide the group, the weight of the nodes does not determine how the 
group is divided. Next, the area is partitioned dependent on each group's normalized 
weight (block 32), The normalized weight of node 25B is now 2/5 and the normalized 
weight of node 25C is 3/5 so the area E,F,C,D is proportionally divided by partition 
28B into two areas such that node 25B is assigned to 2/5 of the area and node 25C is 
assigned to 3/5 of the area. As shown in Fig. 2C, the area E,G,H,D is assigned to the 
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handheld products (node 25B) and the area G,F,C,H is assigned to the desktop 
products (node 25C). The imaging product area B,IJ,C is proportionally divided in 
the same manner as the computing product area by partitions 29 A and 29B. 

[0030] Fig. 4 shows a first embodiment of an apparatus for partitioning a three- 
dimensional graphical environment dependent on a database of objects and 
corresponding object metadata that includes a tree deriver 40, a weight determiner 41 
and an area partitioner 42. The tree deriver 40, coupled to the database and the object 
metadata, derives a hierarchical tree representative of the database of objects based on 
the object metadata. The weight determiner 41 obtains hierarchical tree information 
from tree deriver 40 that includes at least the parent, child, and object node 
information as well as any initial weighting of the nodes. The weight determiner 41 
determines the weight of each parent node and provides these weights to the area 
partitioner 42. Using the node weights provided from the weight determiner 41, the 
area partitioner 42 proportionally divides each area associated with each parent node 
having at least two associated child nodes into a plurality of areas corresponding to 
each of the associated child node weights to determine the partition location 
information. 

[0031] Fig. 5 shows a second embodiment of the apparatus for partitioning a three- 
dimensional graphical environment that includes a tree deriver 50, a weight 
determiner 51, a node grouper 52, and an area partitioner 53. The tree deriver 50 
provides derived hierarchical tree information to the weight determiner 51, which in 
turn determines the weight of each node and provides it to the node grouper 52. The 
node grouper identifies parent nodes and divides the child nodes of each parent node 
into N groups of one or more nodes each dependent on the combined normalized node 
weight of each group of nodes such that the combined weight of each group 
approaches a ratio of R=l/N. The area partitioner 53 determines how the area 
associated with the parent node is to be partitioned dependent on the combined 
normalized weights of each group of child nodes. 

[0032] According to this embodiment, the area associated with the parent node can be 
divided with a horizontal partition or a vertical partition. Referring to Fig. 2C, 28A 
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and 29A are horizontal partitions and 27A, 28B and 29B area vertical partitions. The 
area partitioner includes a horizontal parti ti oner 53 A, a vertical parti tioner 53B, and an 
aspect ratio determiner 53C. One of a horizontal or vertical partition is used to divide 
areas dependent on the aspect ratio of the area created by the partitions. Since, in 
general, square rooms are more aesthetically pleasing than long skinny rooms in a 
three-dimensional graphical environment, it is preferred to divide the environment 
into more squarish areas, or in other words, areas having smaller aspect ratios. Hence, 
aspect ratio determiner 53C determines the aspect ratio for the areas that would be 
created by each of a vertical and horizontal partition and then the partition that yields 
the smallest aspect ratio for each area is selected to partition the area. It should be 
understood that an alternative embodiment is possible in which the partition type (i.e., 
vertical or horizontal) is selected which creates areas having some function of a 
selected aspect ratio. In still another embodiment, a partition type that is neither 
vertical nor horizontal (not shown) may be selected dependent on other selection 
criteria. For example, partitions may be at angles other than orthogonal or they might 
not even be straight partitions. 

[0033] It should be understood that the apparatus shown in Figs. 4 and 5 can be 
implemented in any combination of hardware, software, or firmware. 

[0034] In the preceding description, numerous specific details are set forth in order to 
provide a thorough understanding of the present invention. It will be apparent, 
however, to one skilled in the art that these specific details need not be employed to 
practice the present invention. In other instances, well-known techniques have not 
been described in detail in order to avoid unnecessarily obscuring the present 
invention. 

[0035] In addition, although elements of the present invention have been described in 
conjunction with certain embodiments, it is appreciated that the invention can be 
implemented in a variety of other ways. Consequently, it is to be understood that the 
particular embodiments shown and described by way of illustration is in no way 
intended to be considered limiting. Reference to the details of these embodiments is 
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not intended to limit the scope of the claims which themselves recited only those 
features regarded as essential to the invention. 
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